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ABSTRACT 

At the request of the Department of Mathematics at 
the University of Texas Austin (UT Austin) . the Measurement and 
Evaluation Center conducted a validity study to assist in revising 
the department's placement policy for Mathematics 403K (M 403K) . The 
existing decision score on the College Board Achievement Test in 
Mathematics Level 1 (460) was causing unacceptable placement error. 
Data, including Achievement Test scores and final course grades, were 
analyzed for 1,337 fall semester students and 781 spring semester 
students. A recommendation was made that the decision score of 460 be 
changed to 530. Faculty representatives subsequently lowered the 
decision score to 480, although students with scores from 480 to 520 
were advised that completing an algebra course prior to enrolling in 
M 403K would probably improve their grades. Eight tables present 
analysis data. (SLD) 
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TWO-SEMESTER VALIDITY STUDY OF THE USE OF THE COLLEGE BOARD ACHIEVEMENT 
TEST IN MATHEMATICS LEVEL I FOR PLACEMENT INTO M 403K 

AT UT AUSTIN 
FALL 1988 and SPRING 1989 

Lynn M. Trent, Michael J. Barrett, Barbara G. Dodd, 
and H. Paul Kelley 

At the request ot the Department of Mathematics at The University of Texas at Austin, the 
Measurement and Evaluation Center (MEC) conducted a validity study to assist the department in 
revising its placement policy for Mathematics 403K (M 403K). For the testing period April 1988 
through March 1989, the department had found that its existing decision score of 460 on the College 
Board Achievement Test in Mathematics Level I was causing unacceptable placement error, shown by 
the fact that students in M 403K with scores close to 460 were performing poorly. 

MEC staff members gathered data from two semesters for students with both Math Level I scores 
and M 403K final grades. The staff analyzed test scores in relation to student course performance, as 
measured by final course grade, in order to present to the Department of Mathematics possible 
placement decision scores. 

Method 

Subjects 

From University records MEC staff members gathered data consisting of both Math Level I 
scores and M 403K final grades for students enrolled in M 403K for the first time — 1 ,337 in the fall 
semester of 1988 and 781 in the spring semester o: 1989. The Mathematics Level I test is used by 
the department for placing students in its lower division mathematics course sequences. M 403K 
(Calculus for Business and Economics) is the introductory calculus course for the business 
mathematics sequence. Students lacking sufficient demonstrated competence on the Math Level I 
ter* in prerequisite skills for differential and integral calculus must satisfy pre-calculus course 
prerequisites before registering for M 403K. Therefore students with low scores on the Math Level I 
test ha^. earned credit for at least one college-level mathematics course prior to enrolling in Math 
403K; this additional instruction in mathematics would be expected to reduce the relationship 
between the Math Level I scores and the final grades in M 403K. 
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Materials 

The Math Level I Test is an achievement test administered six times yearly nationwide by The 
College Board, and before each registration period and during all summer orientation sessions on the 
UT Austin campus by the MEC. The Math Level I Test consists of 50 multiple-choice items sampling 
topics including algebra, plane Euclidian geometry, trigonometry, functional notation, and 
mathematical reasoning. Scores are reported in increments of 10 using The College Board's 200-800 
scale. 

Procedure 

After obtaining test score and final course grade data from University records, MEC staff 
members analyzed the relationship between test score and final course grade to obtain test score 
mean and standard deviation, final course grade mean and standard deviation, and the coefficient of 
correlation between test scores and course grades. Frequency distributions of the test scores (200- 
800 scale) were crosstabulated with final course grades (0-4 scale), and regression equations were 
obtained by which to estimate expected test scores from final grades, and expected final grades from 
test scores. Additional analyses were performed to estimate for each test score value the accuracy of 
placement to be expected if that value were to be used as a decision score. A table of possible 
decision scores was prepared for departmental consideration. 

Results 

MEC staff members prepared Tables 1.1-1.4 and 2.1-2.4 to present the results of the validity 
studies to faculty members in the Department of Mathematics. The first set of tables is based upon 
the 1,377 matching sets of test scores and final grades from the 1988 fall semester, and the second 
set of tables is based upon the 781 matching sets of test scores and final grades from the 1989 spring 
semester. 

Fall 1988 Study 

Table 1.1 shows the frequency distribution of test scores (left column) crosstabulated with the 
five course grade levels F through A (0 through 4, columns 3-7) and with the total group of 1,337 
students (right column). Across the bottom of the table are (a) the number and percentage of 
students in each grade level and in the total group, and (b) the test score mean and standard deviation 
for each grade level and for the total group. To the right are the final course grade mean (2.11) and 
standard deviation (1.3':) for the entire group, the coefficient of correlation between test scores and 
final course grades (.42), and two regression equations for estimating expected grades and expected 
scores . 
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Table 1.1 



Scores on The College Board Achievement Tesr in Mathematics Level I in Relation To Student 
Performance in Mathematics 403K: Frequency Distributions, Descriptive Statistics, 
Regression Equations, Expected Grades, and Expected Scores 

Fall 1988 
(N- 1,337) 





Final Grades in Mathematics 403K 




Test 


Expected 


0 


1 


2 


3 


4 


Total 


Scores 


Grades 


F 


D 


C 


B 


A 


N 


580-800 


2.39-4.00 


36 


32 


91 


146 


151 


456 


560-579 


2.24-2.38 


18 


15 


40 


37 


27 


137 


550 


2.16 


14 


10 


23 


28 


16 


91 


540 


2.08 


7 


9 


13 


14 


1 


44 


530 


2.01 


8 


7 


13 


11 


10 


49 


520 


1.93 


23 


13 


14 


19 


8 


77 


510 


1.85 


15 


11 


29 


21 


3 


79 


500 


1.77 


10 


6 


16 


14 


2 


48 


490 


1.70 


16 


12 


25 


8 


1 


62 


480 


1.62 


10 


15 


14 


11 


2 


52 


470 


1.54 


22 


20 


12 


8 


2 


64 


460 


1.47 


15 


14 


21 


5 


3 


58 


400-459 


1.00-1.46 


29 


27 


32 


9 


2 


99 


200-399 


0.00-1.00 


2 


7 


7 


5 


0 


21 


Total 


225 


198 


350 


336 


228 


1,337 


% 


17% 


15% 


26% 


25% 


17% 


100% 


Mean Score 


513.24 


508.59 


530.23 


563.45 


599,82 


544,38 


Standard Deviation 


59.14 


65.73 


66.45 


66.63 


60,90 


71.71 


Exoected Score 


497 


519 


542 


565 


587 





Expected Grade * 
(Test Score x 
0.0077) - 2.0754 



Expected Score » 
(Preliminary Grade x 
22.6514) +496.6405 



Mean 


Standard 


Grade 


Deviation 


2.11 


1.32 



Coefficient of 
Correlation 

r=r .42 
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Table 1 .2 

Scores on The College Board Achievement Test in Mathematics Level I in 
Relation To Student Performance in Mathematics 403K: Combined 
Frequency Distributions and Descriptive Statistics 
Fall 1988 
(N- 1,337) 





Final Grades in M 403K 




Test 


Unsatisfactory 


Satisfactory 


Total 


Scores 


0,1 


2-4 


N 


580-800 


68 


388 


456 


560-579 


33 


104 


137 


550 


24 


67 


91 


540 


16 


28 


44 


530 


15 


34 


49 


520 


36 


41 


77 


510 


26 


53 


79 


500 


16 


32 


48 


490 


28 


34 


62 


480 


25 


27 


52 


470 


42 


22 


64 


460 


29 


29 


58 


400-459 


56 


43 


99 


200-399 


9 


12 


21 


Total 


423 


914 


1,337 


% 


32% 


68% 


100% 


Mean Score 


511.06 


559.80 


544.38 


Standard Deviation 


62.28 


70.56 


71 .71 



Mean 


Standard 


Grade 


Deviation 


2.11 


1.32 



Coefficient of 
Correlation 
r= .42 
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Table 1.3 



Scores on the College Board Achievement Test in Mathematics Level I 
in Relation to Student Performance in Mathematics 403K: Possible 
Decision Scores and Corresponding Accuracies of Placement 
Fall 1988 
(N m 1,337) 



Place- 
men! 
Cateaorv 


Cumulc 
of 


itive Numoer 
Students 


Percent ot Students in 
Each Placement Cateqorv 


Overall Accuracy 
of Placement 


Unsatisfactnrv 
0.1 (N-423) 


Q. tcf ar*tn rv 

OtuilwlOwlU! j 

2-4 (N-914) 


Unsatisfactory 


Satisfactory 


Placement 
Accuracy 


Numoer of 
Students 


%of 
Students 


560 - up 
Below 560 


Too High 101 
Correct 322 


492 Correct 
422 Too Low 


Too High 24% 
Correct 76% 


54% Correct 
46% Too Low 


Too High 
Correct 
Too Low 


101 
814 
422 


8% 
61% 
32% 


550 - up 
Below 550 


Too High 125 
Correct 298 


559 Correct 
355 Too Low 


Too High 30% 
Correct 70% 


61% Correct 
39% Too Low 


Too High 
Correct 
Too Low 


125 
857 
355 


9% 
64% 
27% 


540 - up 
Below 540 


Too High 141 
Correct 282 


587 Correct 
327 Too Low 


Too High 33% 
Correct 67% 


64% Correct 
36% Too Low 


Too High 
Correct 
Too Low 


141 
869 

327 


11% 
65% 
24% 


530 - up 
Below 530 


Too High 156 
Correct 267 


621 Correct 
293 Too Low 


Too High 37% 
Correct 63% 


68% Correct 
32% Too Low 


Too High 
Correct 
Too Low 


156 
888 

293 


12% 
66% 
22% 


520 - up 
Below 520 


Too High 192 
Correct 231 


662 Correct 
252 Too Low 


Too High 45% 
Correct 55% 


72% Correct 

28% Too Low 


Too High 
Correct 
Too Low 


192 
893 

252 


14% 
67% 
19% 


510 - up 

Below 510 


Too Hign 218 
Correct 205 


715 Correct 
199 Too Low 


Too High 52% 
Correct 48% 


78% Correct 

22% Too Low 


Too High 
Correct 
Too Low 


218 
920 
199 


16% 
69% 
15% 


500- up 
Below 500 


Too High 234 
Correct 189 


747 Correct 
1 67 Too Low 


Too High 55% 
Correct 45% 


82% Correct 
1 8% Too Low 


Too High 
Correct 
Too Low 


234 
936 
167 


18% 
70% 
12% 


490 - up 
Below 490 


Too High 262 
Correct 161 


781 Correct 
133 Too Low 


Too High 62% 
Correct 38% 


85% Correct 
15% Too Low 


Too High 
Correct 
Too Low 


262 
942 
133 


20% 
70% 
10% 


480 - up 
Below 480 


Too High 287 
Correct 136 


808 Correct 
106 Too Low 


Too High 68% 
Correct 32% 


88% Correct 

12% Too Low 


Too High 
Correct 
Too Low 


287 
944 

106 


21% 
71% 
8% 


470 - up 
Below 470 


Too High 329 
Correct 94 


830 Correct 
84 Too Low 


Too High 78% 
Correct 22% 


91% Correct 
9% Too Low 


Too High 
Correct 
Too Low 


329 
924 
84 


25% 
69% 
6% 


460 - up 
Below 460 


Too High 358 
Correct 65 


859 Correct 

55 Too Low 


Too High 85% 
Correct 1 5% 


94% Correct 

6% Too Low 


Too High 
Correct 
Too Low 


358 
924 
55 


27% 
69% 
4% 
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Table 1 A 



Scores on The College Board Achievement Test in Mathematics Level I 
in Relation to Student Performance in Mathematics 403K: Scores 
Suggested by Six Guidelines for Use in Selecting Decision Scores 

Fall 1988 
(N* 1,337) 



Mathematics 

Guideline Level I 

Score 



1 . Expected Score tor students whose performance in course was just minimally 
satisfactory (i.e., students with preliminary grades of C; see Expected Score 

row at bottom of Table 1.1). 542 

2. Score for which Expected Grade was just minimally satisfactory (i.e., C; see 

Expected Grade column in Table 1 .1). 530 

3. Score for which percents of errors of students in each academic performance 
category (Unsatisfactory, Satisfactory) were most nearly equal. (See % Too 

High and % Too Low values in middle columns of Table 1 .3.) 540 



4. Score for which overall percents of errors were most nearty equal. (See % 

Too High and % Too Low values in last column of Table 1 .3.) 510 

5 . Score that would have cut off (or held back) approximately the same number of 
students as were in the Unsatisfactory performance group. (See Table 1 .2 for 
number of students in the Unsatisfactory group and the test score that most 

nearly identifies that number of low-scoring students.) 5 1 0 



6. Score that would have maximized overall accuracy of placement. (See number 

Correct in next-to-last column of Table 1 .3.) 480 
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Table 1 .1 also presents values for two variables estimated using the two regression equations 
shown: the Expected Grade (column 2) for each test score, and the Expected Score (bottom row) for 
each grade level. These data may be used, for example, to determine thu the minimally satisfactory 
grade of C (2.00) is expected for the group of students with the test score of 530, or that for students 
achieving a final grade of C, the expected test score is 542. 

Table 1 .2 collapses the five grade levels of Table 1.1 into two performance levels: Unsatisfactory 
(grades Fand D, or 0 and 1), and Satisfactory (grades C, B, and A or 2, 3, and 4). Across the bottom 
of Table 1.2 appear the number and percentage of students in each performance category, and the 
test score mean and standard deviation for each level. 

Table 1.3 presents the expected placement accuracies for 11 possible decision scores. In the 
left column are placement categories (possible decision scores). Two pairs of columns to the right 
present, respectively, the cumulative number and percentage of students in each academic 
performance category (Unsatisfactory and Satisfactory) who would be placed correctly and incorrectly 
using each of the possible decision scores. Incorrect placement for students in the Unsatisfactory 
category means being placed "Too High," while incorrect placement for students in the Satisfactory 
category means being placed Too Low." The final three columns present the overall accuracy of 
placement (Too High," "Correct,** and "Too Low") by number and percentage for the two academic 
categories combined. 

Table 1 .4 lists six guidelines suggested by various authorities for selecting decision scores to be 
used for course placement and awarding of credit by examination. Each guideline refers the reader to 
one of the preceding tables. Based on this validity study, possible decision scores justified by the six 
guidelines range from a low of 480 to a high of 542. 

Spring 1989 Study 

Table 2.1 shows the frequency distribution of test scores (left column) crosstabulated with the 
five course grade levels F through A (0 through 4, columns 3-7) and with the total group of 781 
students (right column). Across the bottom of the table are (a) the number and percentage of 
students in each grade level and in the total group, and (b) the test score mean and standard deviation 
for each grade level and for the total group. To the right are the final course grade moan (2.07) and 
standard deviation (1 .41) for the entire group, the coefficient of correlation between test scores and 
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Table 2.1 

Scores on The College Board Achievement Test in Mathematics Level I in Relation To Student 
Performance in Mathematics 403K: Frequency Distributions, Descnptive Statistics, 
Regression Equations, Expected Grades, and Expected Scores 
Spring 1989 
(N-781) 





Final Grades in Mathematics 403K 




Test 


Expected 


0 


1 


2 


3 


4 


Total 


Scores 


Grades 


F 


0 


c 


B 


A 


N 


580-800 


2.31-3.50 


32 


17 


43 


46 


86 


224 


560-579 


2.21-2.31 


23 


9 


10 


25 


17 


84 


550 


2.15 


6 


8 


12 


6 


9 


41 


540 


2.10 


1 


12 


8 


4 


11 


36 


530 


2.04 


15 


7 


8 


7 


7 


44 


520 


1.99 


7 


7 


11 


9 


2 


36 


C10 


1.94 


14 


8 


15 


6 


7 


50 


500 


1.88 


9 


5 


9 


12 


3 


38 


490 


1.83 


10 


6 


18 


6 


4 


44 


480 


1.77 


6 


6 


11 


10 


1 


34 


470 


1.72 


8 


5 


13 


6 


4 


36 


460 


1.?7 


18 


8 


13 


6 


6 


51 


400-459 


1.34-166 


9 


13 


13 


20 


3 


58 


200-399 


0.26-1.34 


3 


0 


0 


1 


1 


5 


Total 


161 


111 


184 


164 


161 


781 


% 


21% 


14% 


24% 


21% 


21% 


100% 


Mean Score 


523.35 


522.25 


527.77 


534.09 


578.94 


537.95 


Standard Deviation 


61.63 


60.93 


62.53 


67.28 


67.10 


67.40 


Exoected Score 


513 


525 


537 


549 


562 





Expected Grade > 
(Test Score x 
0.0054) -.8179 



Expected Score » 
(Preliminary Grade x 
1 2.1 897 1 + 512.7448 



Mean 


Standard 


Grade 


Deviation 


2.07 


1.41 



Coefficient of 
Correlation 
r-.26 



JO 



9 



Table 2.2 

Scores on The College Board Achievement Test in Mathematics Level I in 
Relation To Student Performance in Mathematics 403K: Combined 
Frequency Distributions and Descriptive Statistics 
Spring 1989 
(N»781) 





Final Grades in M 403K 




Test 


Unsatisfactory 


Satisfactory 


Total 


Scores 


n 1 


2-4 


N 


580-800 


49 


175 


224 


560-579 


32 


52 


84 


550 


14 


27 


41 


540 


13 


23 


36 


530 


22 


22 


44 


520 


14 


22 


36 


510 


22 


28 


50 


500 


14 


24 


38 


490 


16 


28 


44 


480 


12 


22 


34 


470 


13 


23 


36 


460 


26 


25 


51 


400-459 


22 


36 


58 


200-399 


3 


2 


5 


Total 


272 


509 


781 


% 


35% 


65% 


100% 


Mean Score 


522.90 


545.99 


537.95 


Standard Deviation 


61.24 


69.20 


67.40 



Mean 


Standard 


Grade 


Deviation 


2.07 


1.41 



Coefficient of 
Correlation 
r= .26 
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Table 2.3 

Scores on the College Board Achievement Test in Mathematics Level I 
in Relation to Student Performance in Mathematics 403K: Possible 
Decision Scores and Corresponding Accuracies of Placement 
Spring 1939 
(N-781) 





Cumulative Number 


Percent of Students in 


Overall Accuracy 


Place- 




of Students 


Each Placement Cateqory 




of Placement 


ment 


Unsatisfactory 


Satisfactory 








Placement 


Numoer of 


% of 


Catenorv 


0,1 (N»272) 




Unsatisfactory 


Satisfactory 


Accuracy 


Students 


Students 


560 - up 


Too High 


£11 


007 r>rrar*t 

LsorrecT 


Tnn Hinh 


30% 


45% Correct 


Too Hioh 


81 


10% 












COfTBCt 


418 


54% 


Below 560 


Correct 




dOc 1 OO LOW 


UUII tJUl 


70% 


55% Too Low 


Too Low 


282 


36% 


550 - up 


Too High 




^o4 oorrect 


Tnn Winh 
i uu riiy j i 


35% 


ou /o our i ovA 


Tnn Winh 
i uu niyn 


Q5 

WW 


} Cm /O 












f^nrront 

v-/U 1 1 OU 


431 


55% 




Correct 


1 77 


CJJ 1 OO LOW 


wurr eci 


fi5% 

OJ/O 


50% Too Low 


Too Low 


255 


33% 


540 - up 


Too High 


1 no 
l Uo 


c// uorrect 


i oo nign 


ah% 

HU /O 


w 4 ** /<© wUllOUl 


Tnn Winh 
i uu n ly 1 1 


108 


1 4% 

• ~T /O 












Contract 

V/UI 1 Owl 


441 


56% 


Rfllnw 540 

UC3IUYV sJ*-r\J 


Correct 


1 64 


co^ 1 00 LOW 


Correct 


OU /o 


Afi% Tnn 1 n\w 

*4vJ /O t UU LUW 


Too Low 




30% 


530 - up 


Too High 


A On 

i oU 


299 oorrect 


I oo nign 


*VO /o 


J9 /o L/Oi idu 


Tn n W in h 
i u u n ly 1 1 


1 ^n 

1 OU 


1 7% 

l / /O 












worreci 


441 


56% 


UOIUW JjU 


Correct 


142 


£ 1 U 1 00 LOW 


Correct 


0«c /o 


*♦ 1 /O | UU LUW 


Too Low 


210 


P7% 


520 - up 


Too High 


AAA 

144 


oci uorrect 


l oo nign 


OO /o 


oo /o oorrecT 


Ton Wirth 

1 ou niyn 




l . O 














^orro/ ,| t 

UUllDUl 


449 


57% 


UUlUW o£U 


Correct 


A OO 

1 28 


1 oo 1 00 LOW 


oorreci 




o / /o I OU LOW 


Too Low 


l oo 


94% 

c*+ /o 


510 -uf 


Too High 


l OO 


o4y uorreci 


Tnn Winh 
I oo niyn 


61% 
U 1 /o 


/o UUl lOCl 


Tn o 1-1 in h 

I uo my 1 1 


1 OU 


91% 

c \ /o 












r^nrront 

OU 1 1 Owl 


455 


58% 


Relnw 51 0 


Confront 

V./UI 1 cut 


1 06 


l OU I OO LOW 


Correct 


39% 


*3 1 % Tnn I nut 

O 1 /O 1 UU LUW 


Too Low 


160 


20% 


500 - up 


Too High 


180 




Too High 


66% 


73% Correct 


Tnn Winh 
I uu my 1 1 


180 


23% 












Correct 


465 


60% 


Below 500 


Correct 


92 


136 Too Low 


Correct 


34% 


27% Too Low 


Too Low 


136 


17% 


490 - up 


Too High 


196 


401 Correct 


Too High 


72% 


79% Correct 


Too High 


196 


25% 












Correct 


477 


61% 


Below 490 


Correct 


76 


108 Too Low 


Correct 


28% 


21% Too Low 


Too Low 


108 


14% 


480 - up 


Too High 


208 


423 Correct 


Too High 


76% 


83% Correct 


Too High 


208 


27% 












Correct 


487 


62% 


Below 480 


Correct 


64 


86 Too Low 


Correct 


24% 


1 7% Too Low 


Too Low 


86 


11% 


470 - up 


Too High 


221 


446 Correct 


Too High 


81% 


88% Correct 


Too High 


221 


28% 












Correct 


497 


64% 


Below 470 


Correct 


51 


63 Too Low 


Correct 


19% 


12% Too Low 


Too Low 


63 


8% 


460 - up 


Too High 


247 


471 Correct 


Too High 


91% 


93% Correct 


Too High 


247 


32% 












1 Correct 


496 


64% 


Beiow 460 


Correct 


25 


38 Too Low 


I Correct 


9°/c 


> 7% Too Low 


j Too Low 


38 


5% 
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Table 2.4 

Scores on The College Board Achievement Test in Mathematics Level I 
in Relation to Student Performance in Mathematics 403K: Scores 
Suggested by Six Guidelines for Use in Selecting Decision Scores 

Spring 1989 
(N-781) 





Guideline 


Mathematics 
Level 1 
Score 


1. 


Expected Score for students whose performance in course was just minimally 
satisfactory (i.e., students with preliminary grades of C; see Expected Score 
row at bottom of Table 2.1). 


537 


2. 


Score for which Expected Grade was just minimally satisfactory (i.e., C; see 
Expected Grade column in Table 2.1). 


530 


3. 


Scorfi for whinh nprcpnte nf pmnr<t nf Qtnripntc in oarh araHomir narfnrmnn^n 
» lui rvini'M pcivcmo wi ciivjio ui oiuuciiio in cau i civ^oucitiic psnormance 

category (Unsatisfactory, Satisfactory) were most nearly equal. (See % Too 

High and % Too Low values in middle columns of Table 2.3.) 


540 


4. 


Score for which overall percents of errors were most nearly equal. (See % 
Too High and % Too Low valubs in last column of Table 2.3.) 


510 


5. 


Score that would have cut off (or hald back) approximately the same number of 
students as were in the Unsatisfactory performance group. (See Table 2.2 for 
number of students in the Unsatisfactory group and the test score that most 
nearly identifies that number of low-scoring students.) 


510 


6. 


Score that would have maximized overall accuracy of placement. (See number 
Correct in next-to-last column of Table 2.3.) 


470 
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final course grades (.26), and two regression equations for estimating expected grades and expected 
scores. 

Table 2.1 also presents values for two variables estimated using the two regression equations 
shown: the Expected Grade (column 2) for each test score, and the Expected Score (bottom row) for 
each grade level. These data may be used, for example, to determine that the minimally satisfactory 
grade of C (2.00) is expected for the group of students with the test score of 530, or that for students 
achieving a final grade of C, the expected test score is 537. 

Table 2.2 collapses the five grade levels of Table 2.1 into two performance levels: Unsatisfactory 
(grades Fand D, or 0 and 1), and Satisfactory (grades C, 0, and A, or 2, 3, and 4). Across the bottom 
of Table 2.2 appear the number and percentage of students in each performance category, and the 
test score mean and standard deviation for each level. 

Table 2.3 presents the expected placement accuracies for 11 possible decision scores. In the 
left column are placement categories (possible decision scores). Two pairs of columns to the right 
present, respectively, the cumulative number and percentage of students in each academic 
performance category (Unsatisfactory and Satisfactory) who would be placed correctly and incorrectly 
using each of the possible decision scores. Incorrect placement for students in the Unsatisfactory 
category means being placed "Too High," while incorrect placement for students in the Satisfactory 
category means being placed "Too Low." The final three columns present the overall accuracy of 
placement ("Too High," "Correct," and 'Too Low") by number and percentage for the two academic 
categories combined. 

Table 2.4 lists six guidelines suggested by various authorities for selecting decision scores to be 
used for course placement and awarding of credit by examination. Each guideline refers the reader to 
one of the preceding tables. Based on this validity study, possible decision scores justified by the six 
guidelines range from a low of 470 to a high of 540. 

Discussion and Decision Making 

During a January 1990 meeting with the Department of Mathematics faculty, MEC staff members 
recommended changing the then-current decision score of 460 to 530, which was the score for which 
the Expected Grade was just minimally satisfactory (see Guideline 2 in Tables 1.4 and 2.4). The 
department faculty representatives felt a decision score of 530 would result in too many students 
being placed in a course which might not be useful to them; consequently, the faculty representatives 
chose 480 as the new decision score. Students with Math Level I scores between 480 and 520, 

14 
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however, would be told that data suggest that completing M 301 (College Algebra) prior to enrolling in 
M 403K probably will improve their grades in M 403K. The department subsequently approved a 
placement plan based on four Math Level I score ranges: 

Range Placement Decision 

200-399 "Lew Score": consult advisor 
400-479 Must take M 301 before taking M 403K 

480-579 May take M 403K, but data show that those with scores between 480- 

520 probably will improve their grades by taking M 301 first 
580-800 May take M 403K, but consult with advisor concerning alternatives 

The placement plan was implemented beginning with the April 1990 testing period. 



